Vehicle with wearable for identifying one or more vehicle occupants

ABSTRACT

A system includes a vehicle, the vehicle comprising a control system and a wireless transceiver operatively connected to the control system. The control system is configured to wirelessly communicate with a wearable device worn by a user using the wireless transceiver. The control system is configured to receive biometric input from one or more sensors of the wearable device to identify an occupant of the vehicle or individual proximate the vehicle. The wearable device may be a wearable earpiece with one or more sensors.

PRIORITY STATEMENT

This application is continuation of U.S. patent application Ser. No.15/356,839 filed on Nov. 21, 2016, which claims priority to U.S.Provisional Patent Application No. 62/260,436, filed on Nov. 27, 2015,all of which are titled “Vehicle with Wearable for Identifying One orMore Vehicle Occupants” and all of which are hereby incorporated byreference in their entirety.

FIELD OF THE INVENTION

The illustrative embodiments relate to vehicles. More particularly, butnot exclusively, the illustrative embodiments relate to a vehicle whichintegrates with or communicates with a wearable device such as anearpiece or a set of earpieces to identify one or more vehicleoccupants.

BACKGROUND

Vehicles may come with various types of electronics packages. Thesepackages may be standard or optional and include electronics associatedwith communications or entertainment. However, there are variousproblems and deficiencies with such offerings. What is needed arevehicles with improved electronics options which create, improve, orenhance safety and overall experience of vehicles.

SUMMARY

Therefore, it is a primary object, feature, or advantage of theillustrative embodiments to improve over the state of the art.

It is another object, feature, or advantage of the illustrativeembodiments to communicate between vehicle systems and wearable devices.

It is a further object, feature, or advantage of the illustrativeembodiments to use wearable devices to increase safety in vehicles.

It is a still further object, feature, or advantage of the illustrativeembodiments to allow a user to control one or more functions of avehicle using one or more wearable devices, such as wireless earpieces.

It is a still further object, feature, or advantage of the illustrativeembodiments to allow a vehicle to identify a driver based on thepresence of a wearable device.

It is a still further object, feature, or advantage of the illustrativeembodiments to allow a vehicle to identify one or more passengers of avehicle based on the presence of wearable devices.

Yet another object, feature, or advantage of the illustrativeembodiments is to allow a vehicle to obtain biometric information abouta driver or passenger using one or more wearable devices.

It is another object, feature, or advantage of the illustrativeembodiments to enhance an existing vehicle through addition of awearable device.

One or more of these and/or other objects, features, or advantages ofthe illustrative embodiments will become apparent from the specificationand claims following. No single embodiment need provide every object,feature, or advantage. Different embodiments may have different objects,features, or advantages. Therefore, the present invention is not to belimited to or by an objects, features, or advantages stated herein.

According to one aspect a system includes a vehicle, the vehiclecomprising a control system and a wireless transceiver operativelyconnected to the control system. The control system is configured towirelessly communicate with a wearable device worn by a user using thewireless transceiver. The control system is configured to receivebiometric input from one or more sensors of the wearable device toidentify an occupant of the vehicle or individual proximate the vehicle.

According to another aspect a system includes a vehicle, the vehiclecomprising a control system, a first wireless transceiver operativelyconnected to the control system, and a wearable device for being worn bya user, a second wireless transceiver disposed within the wearabledevice and configured to wirelessly communicate with the first wirelesstransceiver. The wearable device includes at least one sensor forobtaining biometric input. The wearable device is configured to identifya wearer of the wearable device using the biometric input and convey anidentity of the wearer of the wearable device to the control system.

According to another aspect, a system includes a vehicle, the vehiclecomprising a vehicle network with a plurality of devices in operativecommunication with the vehicle network and a wireless transceiveroperatively connected to the vehicle network. The wireless transceiveris configured to wirelessly communicate with a wearable device worn by auser and after the user is identified, convey sensor data from thewearable device over the vehicle network to one or more of the pluralityof devices.

According to yet another aspect a method includes obtaining sensor dataat a wearable device, determining a user's identity based on the sensordata and if the user has appropriate access rights, communicating dataor commands over a vehicle network to perform vehicle functions.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates one example of a vehicle which integrates withwearable technology.

FIG. 2 illustrates one example of a set of wearable devices in the formof earpieces.

FIG. 3 is a block diagram of one example of a wearable device in theform of an earpiece.

FIG. 4 illustrates a vehicle network or bus allowing differentelectronic modules to communicate with a wearable device.

FIG. 5 illustrates one example of a method.

DETAILED DESCRIPTION

Some of the most important factors in selecting a vehicle such as a carmay be the technology available to enhance the experience. This may beof importance in certain vehicle segments, such as for luxury vehicles.Another important factor in selecting a vehicle may be the availablesafety features. According to various aspects, the illustrativeembodiments allow for wearable devices including earpieces to enhancethe experience of vehicles and according to some aspects, theillustrative embodiments allow for wearable devices, such as earpiecesto enhance the overall safety of the vehicle. Therefore, it is expectedthe technology described herein will make any vehicle so equipped moredesirable to customers, more satisfying to customers, and potentiallymore profitable for the vehicle manufacturer and the presence or absenceof such technology may drive buying decisions of the consumer.Similarly, at least some of the various aspects may be added to existingvehicles as after-market accessories to improve the safety,accessibility, or experience of existing vehicles.

FIG. 1 illustrates one example of use of a wearable device inconjunction with a vehicle. As shown in FIG. 1 there is a vehicle 2.Although the vehicle 2 shown is a full-size sedan, it is contemplatedthe vehicle 2 may be of any number of types of cars, trucks, sportutility vehicles, vans, mini-vans, automotive vehicles, commercialvehicles, agricultural vehicles, construction vehicles, specialtyvehicles, recreational vehicles, buses, motorcycles, aircraft, boats,ships, yachts, trains, spacecraft, or other types of vehicles. Thevehicle 2 may be gas-powered, diesel powered, electric, fuel cell,hydrogen, solar-powered, or human-powered. The vehicle 2 may be activelyoperated by a driver or may be partially or completely autonomous orself-driving. The vehicle 2 may have vehicle control systems 40. Thevehicle control systems 40 are systems which may include any number ofmechanical and electromechanical subsystems.

As shown in FIG. 1, such systems may include a navigation system 42, anentertainment system 44, a vehicle security system 45, an audio system46, a safety system 47, a communications system 48 preferably with awireless transceiver, a driver assistance system 49, a passenger comfortsystem 50, and engine/transmission/chassis electronics systems 51. Ofcourse, other examples of vehicle control sub-systems are contemplated.In addition, it is to be understood there may be overlap between some ofthese different vehicle systems and the presence or absence of thesevehicle systems as well as other vehicle systems may depend upon thetype of vehicle, the type of fuel or propulsion system, the size of thevehicle, and other factors and variables. All or portions of the vehiclecontrol systems 40 may be integrated together or in separate locationsof the vehicle 2.

In the automotive context, examples of the driver assistance system 49may include one or more subsystems such as a lane assist system,autopilot, a speed assist system, a blind spot detection system, a parkassist system, and an adaptive cruise control system. In the automotivecontext, examples of the passenger comfort system 50 may include one ormore subsystems such as automatic climate control, electronic seatadjustment, automatic wipers, automatic headlamps, and automaticcooling. In the automotive context, examples of the safety system 47 mayinclude active safety systems such as air bags, hill descent control,and an emergency brake assist system. Aspects of the navigation system42, the entertainment system 44, the audio system 46, and thecommunications system 48 may be combined into an infotainment system.

One or more wearable devices such as a set of earpieces 10 including aleft earpiece 12A and a right earpiece 12B may in operativecommunication with the vehicle control system 40, such as through thecommunication system 48. For example, the communication system 48 mayprovide a Bluetooth, Wi-Fi, or BLE link to wearable devices or mayotherwise provide for communications with the wearable devices throughwireless communications. The vehicle 2 may communicate with the wearabledevice(s) directly, or alternatively, or in addition, the vehicle 2 maycommunicate with the wearable device(s) through an intermediary devicesuch as a mobile device 4 which may be a mobile phone, a tablet, gamingdevice, media device, computing device, or other type of mobile device.

As will be explained in further details with respect to variousexamples, one or more of the earpieces 10 interact with the vehiclecontrol system 40 in any number of different ways. For example, theearpieces 10 may provide sensor data, identity information, storedinformation, streamed information, or other types of information to thevehicle. Based on this information, the vehicle may take any number ofactions which may include one or more actions taken by the vehiclecontrol system (or subsystems thereof). In addition, the vehicle 2 maycommunicate sensor data, identity information, stored information,streamed information or other types of information to the earpieces 10.

FIG. 2 illustrates one example of a wearable device in the form of a setof earpieces 10 in greater detail. FIG. 1 illustrates a set of earpiecewearables 10 which includes a left earpiece 12A and a right earpiece12B. Each of the earpieces 12A, 12B has an earpiece wearable housing14A, 14B which may be in the form of a protective shell or casing andmay be an in-the-ear earpiece housing. A left infrared throughultraviolet spectrometer 16A and right infrared through ultravioletspectrometer 16B is also shown. Each earpiece 12A, 12B may include oneor more microphones 70A, 70B. Note the air microphones 70A, 70B areoutward facing so the air microphones 70A, 70B may capture ambientenvironmental sound. It is to be understood any number of microphonesmay be present including air conduction microphones, bone conductionmicrophones, or other audio sensors.

FIG. 3 is a block diagram illustrating an earpiece 12. In otherembodiments, the earpieces 12 may represent an over-ear headphone,headband, jewelry, or other wearable device. The earpiece 12 may includeone or more LEDs 20 electrically connected to an intelligent controlsystem 30. The intelligent control system 30 may include one or moreprocessors, microcontrollers, application specific integrated circuits,or other types of integrated circuits. The intelligent control system 30may also be electrically connected to one or more sensors 32. Where thedevice is an earpiece 12, the sensors 32 may include an inertial sensor74 and another inertial sensor 76. Each inertial sensor 74, 76 mayinclude an accelerometer, a gyro sensor or gyrometer, a magnetometer, orother type of inertial sensor. The sensors 32 may also include one ormore contact sensors 72, one or more bone conduction microphones 71, oneor more air conduction microphones 70, one or more chemical sensors 79,a pulse oximeter 76, a temperature sensor 80, or other physiological orbiological sensor(s). Further examples of physiological or biologicalsensors include an alcohol sensor 83, glucose sensor 85, or bilirubinsensor 87. Other examples of physiological or biological sensors mayalso be included in the earpieces 12. These may include a blood pressuresensor 82, an electroencephalogram (EEG) 84, an Adenosine Triphosphate(ATP) sensor, a lactic acid sensor 88, a hemoglobin sensor 90, ahematocrit sensor 92, or other biological or chemical sensors.

A spectrometer 16 is also shown. The spectrometer 16 may be an infrared(IR) through ultraviolet (UV) spectrometer although it is contemplatedany number of wavelengths in the infrared, visible, X-ray, gamma ray,radio, or ultraviolet spectrums may be detected. The spectrometer 16 maybe adapted to measure environmental wavelengths for analysis andrecommendations and thus may be located on or at the external facingside of the earpiece 12.

A gesture control interface 36 is also operatively connected to orintegrated into the intelligent control system 30. The gesture controlinterface 36 may include one or more emitters 82 and one or moredetectors 84 for sensing user gestures. The emitters 82 may be one ofany number of types including infrared LEDs. The earpiece 12 may includea transceiver 35 which may allow for induction transmissions such asthrough near field magnetic induction. A short-range transceiver 34using Bluetooth, BLE, UWB, Wi-Fi or other means of radio communicationmay also be present. The short-range transceiver 34 may be used tocommunicate with the vehicle control system. In operation, theintelligent control system 30 may be configured to convey differentinformation using one or more of the LED(s) 20 based on context or modeof operation of the device. The various sensors 32, the processor 30,and other electronic components may be located on one or more printedcircuit boards, chips, or circuits of the earpiece 12. One or morespeakers 73 may also be operatively connected to the intelligent controlsystem 30.

A magnetic induction electric conduction electromagnetic (E/M) fieldtransceiver 37 or other type of electromagnetic field receiver is alsooperatively connected to the intelligent control system 30 to link theprocessor 30 to the electromagnetic field of the user. The use of theE/M transceiver 37 allows the earpiece 12 to link electromagneticallyinto a personal area network or body area network or another device.

According to another aspect, earpiece wearables may be used to identifyone or more users. Each earpiece wearable may include its own identifier(e.g., IMEI, RFID tag, unique frequency, serial number, electronicidentifier, user-specified name, etc.). In addition, each earpiece 12may be used to determine or confirm identity of an individual wearingit. This may be accomplished in various ways including through voiceimprint. An individual may speak, and their voice may be analyzed by theearpiece 12 and compared to known samples or metrics to identify theindividual. Fingerprints, gestures, tactile feedback, height, skinconductivity, passwords, or other information may also be determined bythe sensors 32 or the earpiece 12 and utilized for authentication.

Other types of user identification and authentication may also be used.For example, an individual may be asked to specify other information tothe earpiece 12 to confirm identity. This may include answering specificquestions. For example, the earpiece 12 may ask multiple questions withyes, no, multiple choice, or free form answers which the correctindividual will know but others are not likely to know. These questionsmay be stored within a database and are questions which the individualassociated with the earpiece 12 specifically provided answers for. Thesequestions may also be based on activities of the user which are storedon the earpiece 12 or are retrievable from a system in operativecommunication with the earpiece 12. These may include information aboutphysical activities, locations, or other activities.

Alternatively, instead of the earpiece performing the analysisassociated with user identification and authentication, necessaryinformation, such as voice samples or voice or gestural responses may becollected by the earpiece 12 and communicated to the vehicle, mobiledevice, or other device for performing the analysis.

Once a user has been identified the user may be authorized to performvarious functions in various ways. For example, the vehicle may beunlocked such as by a person saying “unlock” or the vehicle may beremote started and environmental controls set by a person saying, “startmy car and set temperature to 72 degrees.” These actions may be taken bythe vehicle control system or its subsystems such as an access andsecurity subsystem or a climate control subsystem. In addition, actionsmay be taken based on proximity of the individual to the user or basedon other contextual information.

Various types of vehicle controls may be a part of the vehicle accessand security subsystems. These may include actuators such as actuatorsassociated with door locks or locks associated with other compartments.Other types of vehicle controls may include an ignition lock switchwhich may be unlocked or locked. Other types of vehicle controls mayinclude actuators associated with windows. In addition to thesefunctions, any number of different vehicle functions or relatedprocesses may be performed. The vehicle functions performed by aproperly identified individual may be the same types of vehiclefunctions an individual may perform as a driver of the vehicle. Othertypes of vehicle controls may include any number of settings such asaudio system settings, engine controls/components, temperature controlsettings, entertainment system settings, navigation settings, or othertypes of settings. The earpiece 12 may also be utilized to control(e.g., initiate, end, adjust settings, etc.) vehicle tracking systems,camera systems, anti-locking breaks, traction control systems, fourwheel drive systems, electronic stability control (ESC), dynamicsteering response, driver wakefulness monitoring, assured clear distanceahead, adaptive headlamps, advanced automatic collision notification,automotive night vision, blind spot monitoring, precrash systems, safespeed governing, traffic sign recognition, dead man's switch, and soforth.

FIG. 4 illustrates another example. In FIG. 4, a vehicle network 100 isshown. According to one aspect, the left earpiece and the right earpiece12A, 12B may communicate information through a vehicle network 100associated with the vehicle 2. Thus, once an identity of a user has beenestablished, commands may be communicated over the vehicle network 100or vehicle bus to perform one or more vehicle functions. Protocols whichare used may include a Controller Area Network (CAN), Local InterconnectNetwork (LIN), local area network (LAN), personal area network (PAN), orothers including proprietary network protocols or network protocoloverlays.

Various types of electronic control modules 102, 104, 106, 108 orelectronic control units may communicate over the network 100 of thevehicle 102. These may include electronic modules such as an enginecontrol unit (ECU), a transmission control unit (TCU), an anti-lockbraking system (ABS), a body control module (BCM), a door control unit(DCU), an electric power steering control unit (PSCU), a human-machineinterface (HMI), powertrain control module (PCM), speed control unit(SCU), telematic control unit (TCU), brake control unit (BCM), batterymanagement system, and numerous others. Any number of electronic controlmodules may be operatively connected to the vehicle network 100. Thecommands may represent audio or verbal commands, tactile commands (e.g.,taps, swipes, etc.), head gestures, hand motions near the earpieces 12,or another detectable user feedback. In one embodiment, the variouscommands may be associated with different components and functions ofthe electronic control modules 102, 104, 106, 108. The earpieces 10, anassociated wireless device, an electronic device, or the vehicle 2interface may be utilized to associate the commands with specificactions. Databases, memory data, macro, or scripts may associate theuser command, input, or feedback with the implemented action. Forexample, an application or set of instructions executed by the vehicle 2may associate a head gesture, such as two head nods, with an unlockfunction for the driver's side door of the vehicle 12.

In one embodiment, a wireless transceiver module 110 is operativelyconnected to a vehicle network 100 and it is the wireless transceivermodule 110 which is in operative communication with one or more wearabledevices, such as the wearable earpieces 10. Once an earpiece 12A, 12B orthe vehicle 2 has identified a user, then the user is permitted to giveinstructions which are translated into commands which are communicatedover the vehicle network 100 to an appropriate system or component ofthe vehicle or to communicate data such as data from one or more sensorsof each of the earpieces 12A, 12B. Data from the earpieces 10 may beused by any number of different electronic control modules or electroniccontrol units 102, 104, 106, 108 connected to the vehicle network 100 toperform any number of different vehicle functions.

FIG. 5 illustrates one example of a methodology. In one embodiment, theone or more wearable devices may represent one or more wirelessearpieces, such as those shown and described in the various embodiments.As shown in FIG. 5 at step 120 sensor data is obtained at one or morewearable devices. As previously explained the sensor data may be one ofany number of types. For example, the sensor data may be voice data orother biometric data. In step 122 a determination is made of the useridentity based on the sensor data. Where the sensor data is voice datathis determination may be as the result of a voice print or voice sampleanalysis. Any number of different products or components may be used toperform this analysis. Examples of commercial products for performingsuch functionality include Nuance VocalPassword, Watson, Siri, Alexa,Google Voice, VoiceIT, and numerous others. It should be furtherunderstood other types of biometric data may be used. For example, wherethe wearable device is a pair of glasses than retina identification andauthentication may be used. Where the wearable device is a pair ofgloves, finger print analysis may be used. Similarly, wireless earpiecesmay be utilized to scan fingerprints as well. The determination of theuser identity based on sensor data may be performed in one of severaldifferent locations based on the type of analysis and availablecomputational resources.

For example, the determination may be performed on or at the wearabledevice itself. Alternatively, the determination may be performed on orat the vehicle. Alternatively, still, the determination may be performedby a mobile device such as a smart phone which is in operativecommunication with either the wearable device(s) or the vehicle, orboth.

Once the individual has been identified or recognized, in step 124 adetermination is made as to whether the user has access rights. In oneimplementation, if the user is identified then the user has appropriateaccess rights. In alternative implementations, identifying the user doesnot necessarily give the individual all rights. Where the user hasappropriate access rights, or none are required, in step 126 data orcommands may be communicated over the vehicle network to perform variousvehicle functions. Data from the wearable device(s) may be used by anyelectronic control modules associated with the vehicle network toprovide input to be used in any number of different decision-makingprocesses. Similarly, commands may be given from the user to the vehicleusing the wearable device such as when the wearable device is anearpiece and the commands may be given through voice input from theuser.

Any number of actions or access may be granted for implementationutilizing one or more of the earpieces, vehicle systems, wirelessdevices, or other networked devices. In one example, the user mayreceive a phone call through a wireless device within the vehicle or bya communication system within the vehicle. In response to the user beingauthorized or authenticated, the user may provide feedback utilizing thewireless earpieces, such as a double head nod, thereby accepting thephone call for communication through the speakers and microphones of thevehicle. In addition, the communications may be communicated through thewireless earpieces and augmented by the vehicle communication systems(e.g., displaying the caller, call length, etc.).

In another example, the user may provide a verbal command, such as“enter sport mode”, thereby providing a command to the vehicle to adjustthe performance of the vehicle (e.g., engine torque/output, transmissionperformance, suspension settings, etc.). The wireless earpieces may beconfigured to listen for or receive a command at any time. In otherembodiments, a “listen” mode may be activated in response to an input,such as a finger tap of the wireless earpieces, initiation of a vehiclefeature, head motion, or so forth. The listen mode may prepare thewireless earpieces to receive a command, input, or feedback from theuser.

In another example, the wireless earpieces may provide a method ofmonitoring biometrics of the user, such as heart rate, blood pressure,blood oxygenation, respiration rate, head position, voice output, orother measurements or readings detectable by the various sensors withinthe wireless earpieces and/or the vehicle. For example, the wirelessearpieces may determine the user is fatigued based on the user's heartrate, respiration, and head motion to provide an alert through thevehicle systems, such as a message indicating the user should pull overcommunicated through the infotainment system, a heads-up display (e.g.,electronic glass), or other vehicle systems. For example, the usersettings may indicate the windows are rolled down and the music isturned up until the user can find a suitable place to stop or park. Thewireless earpieces may also warn the user if he is impaired based on adetermined blood alcohol level, cognition test, slurred speech, or otherrelevant factors. As a result, the wireless earpieces may help protectthe user from his or herself, passengers within the vehicle, and thirdparties outside the vehicle. In one embodiment, the wireless earpiecesmay be configured to lock out one or more vehicle systems in response todetermining the user is impaired.

The wireless earpieces may also indicate biometrics in the event thereis an accident, health event, or so forth. For example, the wirelessearpieces may send a command for the vehicle to enter an emergencypullover mode in response to determining the user is experiencing ahealth event, such as a heart attack, stroke, seizure, or other event orcondition preventing the user from safely operating the vehicle. Thewireless earpieces may also send one or more communications to emergencyservices, emergency contacts, or so forth.

In another example, the wireless earpieces may be utilized to monitor ayounger or inexperienced user operating the vehicle. For example, tooperate the vehicle, an administrator of the vehicle may require thewireless earpieces be worn to determine the watchfulness of the userdetermined by factors, such as head position, conversations or audiodetected, activation/utilization of and associated cellular phone, thewireless earpieces, or the vehicle systems. As a result, the wirelessearpieces may be utilized as a parental monitoring feature wall the useris within the vehicle.

The wireless earpieces may also be utilized to perform any number ofsmall tasks significantly enhancing the user experience, such as openingindividual doors, unlocking the trunk, opening windows/sunroofs,starting the vehicle, turning off the vehicle, turning on or off the airconditioning/heater, adjust a seat configuration, turning on amovie/music, or any number of other features commonly utilized by theuser.

The wireless earpieces in conjunction with the vehicle systems, may alsolearn the preferences of the user over time to perform automaticfeatures and settings of the vehicle.

It is further contemplated commands may be automatically communicatedbased on the identity of the user. In other words, once the user hasbeen identified the vehicle may perform one or more vehicle functionsautomatically based on the identity of the user. These functions may beany number of different functions previously discussed includingfunctions granting access or deny access to the user.

Various methods, system, and apparatus have been shown and describedrelating to vehicles with wearable integration or communication. Thepresent invention is not to be limited to these specific examples butcontemplates any number of related methods, system, and apparatus andthese examples may vary based on the specific type of vehicle, thespecific type of wearable device, and other considerations.

What is claimed is:
 1. A system comprising: a vehicle, the vehiclecomprising a control system; and a wireless transceiver operativelyconnected to the control system; a set of wireless earpieces inoperative communication with the wireless transceiver, the set ofwireless earpieces including one or more sensors for providing biometricinput; wherein the control system is configured to receive biometricinput from the set of wireless earpieces and identify an individualusing the set of wireless earpieces by using the biometric input,wherein the individual is an occupant of the vehicle; wherein the set ofwireless earpieces is configured to confirm identity of the individualusing the wireless earpieces.
 2. The system of claim 1 wherein thecontrol system is configured to provide access to the vehicle after theindividual has been identified by the control system using the biometricinput and the identity of the individual is confirmed using the wirelessearpieces.
 3. The system of claim 1 wherein the access is provided byunlocking an ignition of the vehicle.
 4. The system of claim 1 whereinthe access is provided by opening a door or compartment of the vehicle.5. The system of claim 1 wherein the control system is configured todeny access to the vehicle after identifying the individual.
 6. Thesystem of claim 1 wherein the control system is configured to alter oneor more vehicle settings based on an identity of the individual.
 7. Thesystem of claim 1 wherein the one or more sensors comprises a microphoneand wherein the biometric input comprises voice input from theindividual.
 8. The system of claim 1 wherein the biometric inputcomprises inertial data.